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' COMPUTER-BASED' SlilUtATION 

• . Alice ^^^cTa^trford 

Navy Personnel, ..Research and Development Cenjter 



INTJIODUCTION 



. , Computer-based' simulation (CBS) repres*eAts a' unique utilization of 
cojiputers for instruction that combines some of the best features of the 
technologies of simul^ti^rT arid computer-assisted instruction CCAI) . 
Until. a few years ago, CAI had been applied primarily to ttalni^ng skills ' 
such as math and foreign languages with fairly consistent demonstrations 
of Aime sa^vings and instructiona|l effectiveness as compared to conventional 
methodologies Ce.g*, Ford, Slough & llurlock, 1972). *^GBS grew out of aa 
interest «iri testing the application of CAI to procedural ana perceptual "* 
motor skills r skilly that traditionally had been trained with hands-or\ 
practice on real-world objects 'or high fidelity simulators. CB^ offered 
the potential for lox^-cost simulation combined with pedag9g;iQ,^ effectiveness 



" C3S can be conceptualized as two-dimensional" simulation. G<\mputer 

graphics,' or slides are u6ed to create representations of the appearances 

and dynamic operations of ^ physical ,objects or environments. Typically, the 
* » » 

simulation Is programmed in the context of iristxructional text and feedback 
oil a CAI ^system that has a cathode ray ^lube CCRT) or plasma ^anel on which 
the lesson material^ can be displayed'. ^ An intarafttive situation is created 
in ^hat fc^e studeat can manipulate the simulation through, the keyboard, 
touch panel^'^-or 'li^ht pen of the system. The computer evaluates this 
student input, presents feedback, and ca\ises the simulated object; to react 
mucji in the same* way as would its real-world counterpart. 



\ St^verali experimental ^fforts have be^' carried out to evaluate the 

^ * ' ^ ' 

efficacy df CBS for training. \^le the methodology is still in its t 
infilncy, the da^a are conducive to some preliminary gelieraliz^tioas concemin 
training considerations and CBS ^^ystem features... The present paper will ^ 
discuss these early findings and identify directions for future research. . 

• , . TRAINING CONSIDEKATIONS 

, CBS has been use<l effectively to teach sav.eral different types, of 
tasks tQ a variety* of s,tudents^ and a numbet of instructional innovations 
have been develop^ed as by-products; details will be p;:esented in the 
following paragraphs ' ' 



Flight officers on ^nti-submarine. aircraft have been trained to perform 
tactical operations tasks (Crawford,' Hurlock, Padilla^ & Sassano, 1976; 
Crawford, Hurlock, & Rogo', 1977), and civilian pilots have been taught 
to fly holding patterns' (Feurzeig & Lukas., 1971; Trollip, 1*77) through 
the use of CBS. Other studies include, preliminary skills^J^rainitxg for 
"A" school students in the operation of the oscilloscope ^Stem^ 1975),* 
and tdtraPion experiments for college student3 (Hollan, Bui^ersofl & Dunham, 
1971). The^e efforts represent only a sample of ,fhe work t;l3.at, has been ^one 
in the area. / ^ *^ ' - 

CBS materials* are often programmed witKin thd -eont^ext of learning 
strategies or content sequencing algorfthms. -For example', Lahey and Coady 
(1978) have jais^ completed anpther of setera^l studies- invegit^gating - - . 



''ftie ef f ectiveaess^ of a learner controlled lesson that gives basic ^elec^Vonics 
school students practice with a simulated multimeter. The resulting data 
thus ""added - to the knowledge bases ofc both learner strategies and CBS. 

Other interesting uses of CBS, which 'are unrelated to training performance^' 



oriented skills, have emerged in the literature. Rigney ^nd Lutz (1976), for 

r • / , . «- 

example, were interested in ,the effects of imagery on learning and used 
graphic sinulafions of a battery and ^proces^s^such as, ionization and 
reduction ,to teach abstract electrochemical concepts. 

• • / 

In^summary, the research described above , has generally suggested 
the following training advantages f<5r, CB3: Increased, trainee prof iciei^cy, 
time savings, cost effectiveness, and high ^jLtident acceptability. It appears 
that CBS has the potential to be a widely applicable training methodology; 
however, th^' manner in which student and pask characteristics interact wi^th 
fidelity Variables jrenains to be determined. For example, one. study, which 
used simulation that was low in appearance fidelity and relatively high in 
functional fidelity, resulted in lower student acceptability of CBS training 
materials than a previous one, that had utilized the same system and similar 
materials (Crawford, et al., 1977). .It was not clear whether the lower 
acceptability in the latter study was the result of using students with 



more previous^real-world practice, attempting to train /more complex skills, 
or both. In other wor^s, it was impossible to seperate out uni<jue; effects 
'of fidelity ay^d student characteristics. • • ]\\ 

■ ■ • ■■,/;. 



Another fidelity question of inter^^st pertains to the interactive patuire 
of j^raphic siaulation. That is^ how. interactive or funptionally similar • 
to the real-world must a graphic simulation bfe in ordog^ to produce^ 

the desired training* results? This ' certainly has implications for determining 

t- . • ' ^- 

\ 

whether successful training achieved by> CBS is due to the unique cafjabilities" 

of an interactive'^ CBS &ystem or could be achieved by ^some less expensive 

* ^- ' ' . ^ " . ^ 

-medium such as slide pro-jectidlns. There is a study in progress at the Navy 

Personnel Research and Development Center (NAVPERSRANDCEN) that is attempting 

r 

to coutroj the interactive factor; these data should help to cl^kssify 
sorae^^oif'^he^issues raised above (Hurlock,, Note 1). , • * 

.Questions regarding the effects of .Ikppe^rance and functional fidelity. 

must b^ answered in order to predict the transfer effects of. CBS or aAy • 

other variety of simulation. The transfer issue has been in the literature 

for years and has yet to be resolved. However,' while the amount of fidelity 

♦ » 

required to achieve positive transfer of training is still of central interest 
there is a new slant to the question'. Recehtly,' more emphasis has been placed 
on the Liannfer in^ which a'simulatipri is used, i.e., its instructional context, 
than its similarity, to its real-world counterpart. CFor a mote detailed 
discussion of the problem, see Crawford and Crawfoi^d, 1978). . 



Petiodically, attempts have b^en made to' establish prediction^ of ^ transfer 
of performance 's^kills as a *functio| of , fidelity Ce.g., Miller, l553a), b^ut. 
the^e predictions have riot been based on data collected systematically, and, 
in some casjes, have" riot been data=base_d,^at all. Thus, if researchers and 
decision makers, are to take naximum advantage of CBS as. a training methodology 
it will be necessary ^ to tajke a systematic: approach to empirically determining 
how all of* the pertinent variables att .and interact with each other. 



' ' ^ . . . CBS FEATURES ' . ' • * . 

ICnowledg^ regarding the relevance system feafures effecB^^ and 
efficient training is a^sb an area of nevly ewefging interest. H9wever,\ 



some tren ds are be ginning to appear as a result of res^axQbLejsperifence 
with various, systems , and^tlre3e will be described 'here. ^ 

CBS in clearly different trbm'^tand^rd 'CAI in that graphics are used 
extensively* ±t^ place of text. Thi? places an' entirely imique pet of re-*- 
qulrements on software development ,- which^ can be -facilitatedT or* hindered 
by the system^hardware. ^ / ^ , ' v ' " / ^ 

. • ^ • ^ . . : . • ''ij" V * 

A^good example "Illustrating some of tjie differences can^be found in 

the-repprt of a project designed at .NAVPERSRAIJDCEN to evaluate H^e PLATO' 

J ' ' ' ^ 

' » ^- ' • * , 

IV computer-baiSed instructional ayst'^ CHurlock^6c Slt>ugh, 1976). '.The' 

aut^hors provided detailed reviews bf ei:ght experimental CAI lessons that 

were developed and used for the project; fpui^^used srimulati'on and»four \ 

did not.. The siiaulatiori studies used, a combina'tioii' of ^ompu'ter gra^j'oJi^^ 

and microfiche fQr 8t) percent of lesson materials with only ^20 percent''' * 

text. The non-simillation lessons utilized graphics foif 33 j)er<^||fvt 'pf 

the matierials and 67 percent text. The figures for the simulation lessons.^ 

reflect the fact that graphics were used ,as a' response mode 50 percent , 

the time. , Tlint is, half of the time, student performance, was judged' 

on r.anipulatioifs of the graphic simulations instep of on multiple choiee* 

.o^r constructed responses. • * ' . ^ 



Thus the NAVPERSRANDCEN reseaAh shdws the extei^sive role of graphics 
in C^S. Some of the specif ic' s^ystem capabilities' need to support this 
kind of/ development are discussed belox^ -Consideration will be given 

I ■ . , • . : 

storage, capabilities, display technology and input devices, presentation 

I 

capabilities, and data collection. ^ , • ^*>> • • , ^ 

Storage ^ Capabilities • ' 



Hurlock, and Slough (1976) reported that simulation lessons used to 
evaluate J^MTO IV required an average of 50 percent more space for storage 
of material for each on--line*hour than did the lessons' that did not use^ 
copiputer graphics e^xt^nsively . Vfliile the PLATO IV system is capable, of \ 
providing' this kind of storage (as would be the case with any^^Large netwdrk 
system), i.t"^is dedicated, in'philosophy , to the Support of many ^l%s sons 
requiring small anpun^s* of ^extended, course. storage (ECS^ rather than a . « 

few* lessons with^^h amouatst, ' a result, the NAVPERSRANDCEN lessons 

. * " . < , c 

could only ht. run when'user load was low,, or researchers had to accept < 

♦ ' ' 

.decreased terminal utilisation as -a result of increased ECS demands/.^ 
iQsson complexity. Therefore, one of * the* primary requirements of k system 
that x\ going to' b^ used for §imulat|.on is n*ot only sufficient storage, but 
also af detemtinatiort of the aidditional requirements th^it wj^^ be placed .on 
the sy^em. If network systems are to be,'usedu managers will .have to m^e, 
'the appropriate provisions; otherwise, stand-albne systems should be used; 



i 



Tliese comments are based on requiretnei^ts^of cgmputer graphics'^rid do;' 
not adequately reflect feature^s of alternative simulation di^pl-ays such as . 
random access glides. This, mediums Is ^iflStted fo a/sefc number o't'siicl'^s- , 



that can be accessed ^t any given time Casually 80),, and response time^/ 
is/quite slow so thafe it is itifappropriate for complex, interactive simulation. 
T^best .use of slidejS may be as a supplement to interactive graphics. The 
General Electric Training System (GETS^ is one 'stand-alone system that has 
i'ncd'rporated the capabilities for this combination* 



lIicro*fiche displays are another altei:native for two-dimensigjial^- - 

simulation: Researchers in the NAVPERSRANDCEN PLATO" IV prcJject fpund 

that rapLcrof iche;production phases were too involved and resolution of the . 

displays too poor to be acceptable. This was four years ago, however, and 

the sophis^cation of the medium has increased considerably. ' Joseph Rigney 

« 

of the Behavioral Laboratories at. the University of Southern California ha3 
just completed a study using microfiche for teaching simulated troubleshooting. 
Rigney feels that the microfiche approach compares very favorably to t^he 
use. of computer graphics (Kigney, Note 2).^ 

' < ' ^ ^ ' '\ M ' * 

Crt'he*r»^ alternatives may bfe provided by several possible configurations of 
_ videodisc and microtechnology. Videb^isc is an inexpensive, high density 



storage medium, which, in^eombin^t^y^yft ^th sufficient computer support, 
' poi*ld be used for two-dimensionar simula'^ion. At this point in time,* 
statemenC^ about poti^tial applications of videodisc are pure speiiulation 
so it will be int«rsting *to see what the research will shoW in the way 
pf c<ist and '^instructional benefits tradeoffs. . s v 



ERIC 



Disfpftay Technology and Input Devices 



CBS has be-en iiiplemented on 'systems wi^^h both CRT an'd^^-p^asma panel 
* display ^screens. The plasma panel, as usedVn the PLATO^ IV .and GETS 
systems, was judged very favorably by the ^uthtyj^s and students who 
participated in the NAVPERSRANPCEN PLATO IV evaluation project. These 
persons relt that .displays were highly readable and did not cause fatigue, 
or ^eye^ strain, cind the authors commented oii the ease with which displays 
could be ct)ordinated with touch panel input. .They £elt that the panel 

^. .1 ' • . ■ - - ' . 

was Ner^ useful for simulation and other interactive tasks r(Hurlock & 
SlfJugh, ^976)., ' 



♦ l^le the plasma panel^ is limited to the Colors of black and amber, 
this nay not be 'too much of a limitation in that tfij^^effects of color on , 
instructional effectiveness are not cle^r. Kanner (1968) found that the i 

minimal use of color seemed to Kelp stddents to identify, important .inf'ormatipn. 

^ " ' ^ . < 

The tiajority of . the research ia the area, however^ reports no differences 

between color^nd bl^clc .and wh^.te presentations on learning .(Gulliford, 1973). „ 

• ' ' ^ 

The CIlT screen, such as that used in the TICCIT^ystem, is capable of - ^ 
color displays and has |^t least two advantages over the plasma panel. 
*6ne is that the' hardware i^ compatible with the videodisc and if the 
expected benfits of that medium are realized, .systems With CRTs is that 
recent developments, such' as raster ^can technology, promise increased 
memory with simpJLitied cgLrcuitry and lower, oosfes; puch features w^uld be 
clearly beneficial for two-dimensional simulation,. / • , 



Input devides typically /usad for CBS include a standard ^Icavboard I ^ 

» ' * ) ' 

(^.Z*y" Lahey, Crawford, & lUj^r lock, ^1975) , the tduth panel (e.g., Crawford,';, . 

et al., 1976), and the lightpen 'used, with GETS (Radsken & Grosson, 1975) * 

' '* 

and planned for use with simulation on the TICCIT system. In rather ' 
unique applications, Feurzeig and Lukas Cl97lT and Trollip (1977) utilized 



a joystick interfaced with a conputer-based instructional systea for recording 
student .input on ^'flyin^" holding patterns. \ J ^ 

■ K . : ■ -.^ . 

ITliile it would seen that the-^use of th^^ touch* panel or joystick would 
be preferred to the lower fidelity input devices, effective training was 

4 

demonstrated in all four applica-tions. Additionally it should be kept in 
mind that for'sone portion of ^any training situation, the keyboard .will 
provide an inexpensive and pe^rfectly adequate means' for evaluating student 
progress. Input device features and how^ttiey relate "to training effectiveness 
need to'be determined as part of the fidelity research mentioned earlier. 

Presentation Capabilities . ' ' ' 

One obvious problem that emerged from the f4.ndings of the NAVPERSRAl'^lDCEN 

' ■ ^' s \ ^ 

sjLuiies (LLurlock & Slough, 1976) was that network systems such as PLATO IV, 
- '. • • 

which coHpect?>fhe computer to the terminal by telephorie lines, are Hot the- 
^st^systeus ior presentation of simulation materials. Transmission errors 
be^^fi^ the .computer and the terminal,, wh|ch do not seriously disrupt a 
Standard CAI lesson, do distort the simulation display. This oft;en causes 
students to have to start over on complex behavioral sequences and results 
in considerable frustration. Systems suclf as TICCIT or stand-alones^ are not 
subject to -these problems. 



Synten response timers also an iao'brtant factor' to be considered* ' 
Observation suggests, that slow systen response time,, as 'caused b,y^ hardware 
'linitatiohs\ or heavy user loads, lowers at:ce*pt^bility (and presumably' 
peiSagogical e&£^ctiveneVs) * in students vko* have h^ii prevpLous experience „ ' 



xJiirh the real-world counterpart of tjie sjnulation (Crawfard"*, et^ al^, 1*977). 

, As Dfentioned earlier, the results are confounded, but it is clearly an. 
area*needing research. Once again, st;an,d-alone systens*«iay be , the be^t* 
solution. £ETS,* for exaraple, has been- designed specifically to support 

.^teractive graphic displays, This .system is described/as a state transition 
device based on strio^-oriented, as opposed to number-oriented^ processing 
(Rupp, 1976). One. result of this design is faster^ svs-tem response time. 



GETS, for example, 'is apprrc3xiinatel}%f ive times faster than PLATO IV. It / 

is .expected, though not substantiate'd, that the ^architecture of a system , . 

( ^ -^^ ft * ' 

like GETS i^ conducive to ease and speed of courseware dev^^j^ment. For 
exanple, graphics* developed in the G^TS systen are origin-oiri^nted at anjH ^ v' 
given tinQ. - The result is that they can be moved around the Screen to create 
new displays with very little ^^programming. A research. effor>.t that is much' 
ne^^^^uld compare requirements of iderlsfical sets of .material^ on different . 

. .... - 

types of systems in terms of progfanriiing tima, required skill levels of 
programmers, and overaiy. costs.'- 

• ' ' ' 1- 

Dat^ Collection \ . y . * . * ^ 

, Given ^hat^ the primary evaluation issue in CBS is transfer of training^, data 

' ^ ' • ^ • . * ^ \ ' 

comparing CBS performance to real-world performance, is a top prit)rit;y for 




'future -research. _^iowever, some of the benefits of data cSSiectibn within 



7 *' . ' > 

the proofiss of CBS should not be/overlooked. ^ Foi? example, Lahey aud Cpady 



(1978) harV copied out^^^^f the ''trail" (each respofiser 



^ * > made during the 

ylesson) of each student \vA were thus able to assess preferred learning 



strategies iii a learner controlled lesson. - • * 

• * 

The^collectioh of student latency data, which is possible in nost CAI 

systems, can also be usefu^. Williams (Npte 3) has proposed a theoretical 

model q£ student processing capa^ty suggesting t^at J.atency information. 

can be used to evaluate levels of student knowledge. There are also ^ * 

implications here for ^he use of this type of data for validation efforts. 
* 

Thus, capabilities for flexible and assessable data' eduction should always * 
be considered in the design of future systems. 

» t - • 

. SUIEIARy'aiNT) RECOMMS^IDATIONS • ' ^ \ > ^ ^ 

r ^ . ^ * 

The research efforts reviewed here deaonstrate the potential effectiveness 

and efficiency of CBS fo retraining certain perfomance-oriented skills, to 

certain students, under certain circumstances. Assummiag that these positive , 

findings will be more generally applicable, it is now necessary to col^lect 

data and develop a contingency algorithn from which predictive stateiients can 

be nade nbout specifically when, how, and fox whom the nethodology can be used 

.V 

most appropriately. Recotamendations will be made here that parallel the tx70 
major portions of the body 'of the paper: Training considerations and CBS ^ 
system features. * , ' . 



To begin with, it is necessary to4ieternine the combination of. student* 
and task types that, Vjril optimally benefit from training by CBS. It will 



1 o 



then be necessary to specify how these factors interact with, varying levels 
of appearance and functional fidelity with respect to transfer of trai^ng. 
Researchers "have suggested* that a worthwhile approach to this natter night 
be .fourfd in emphasizing functional fidelity as it relates to instructional 
design. Variables of interest, wiJihin this context, are student-curriculun 

^Interaction (the anount necessary), input device technology (comparisons of 

"I ' • 

light pen to touch panel interaction), cues present* in the simulation 

materials (regarding the degree to x^hich they must be .similar qualitatively 

and quantitatively to those present in the real-world), and the roles of ' 

feedback, task analysis, and learning strategies. Thi's line of research, 

then, would be centered around the' tradeoffs, between "good" instructional 

design and fidelity levels. . » • . 

V* 

The other area of research to be discussed here, that of system features, 

\ 

i ' ' - 

is one that should probably b^ initiated after some of the previ.ously mentlbnad 
issues have been resolved. That is, it is difficult to optionally design 
system features when the basic learning parameters remain in question. 

Experience indicates that, given state-of-the-art equipment, the ideal 

system configuration, i.e., on^ incorporating all features that h'ay'^^j^e^n • 

' * '•^^^ 

found to be useful for training, could be characterized in the follot^ing way: , 

♦ * ' *_ ^ 

V 

1. Th^ system should be gtand-alone and designed to support* extensive 

use of interactive graphics material In terms of a flexible authoring 
language ancU presentation capabilitiqis; ^^^^ capabilities would 
permit fast system response- and sufficient storage. ' 



The .systen should have a touch panel or light pen and a keyboard 
for student input. ' This combination would provide a mix of Ihigh 
fidelity interaction and constructed respohses. 



3, A CEfT would seem to be optional since ijt would provide the 
ideal display in that color could be used if desired. Thfit 
system also would be amenable to modification to take advantage 
of advances in the technology such as 'videodisc. 



A. The system should posess both a computer graphics and .microfiche 
or slide capabilities thus pemdttitig presentation, of graphic sim- 
ulatiohs in conjunction witti photographs of real-world objects. 

5. The ideal system should also have capabilities for "collection 

\ 

and hard copy of "trail" and iatency data* IvTiile the feature 
would not affect the quality of the simulation, it would enhance 
^ the value of CBS as a research tool* 



Research. to-date indicates that combining these features could produce 
a CBS system of maximal effectiveness; the question af 'efficiency remains* 
Future reseaxch should examine these features for areas ™of possible reduction^ 
in that the. total suggested configuration's pr^ably unnecessary. It seems 
probable that the "ideal^* system could be streamlined for cost-effectiveness 
while Maintaining the same quality of instruction. For ^example, .the ose of - 
microfiche as an alternative, rather than as a supplement, to computer grahpi,c 

■ '-; • > . . 

may rove to be a reliable finding. Likewise, videodisc i^^ay be a low-cost 
solution to storage problems. 



As stressed eariler one of the most importzant reseacQ^f^i^^remeats 



is a oonpai^son' of authoring capabilities, developnient:,al f iin^>, 'and a 



cost analysis of programing the sane xfraii^ln-g materials on a range of 
%ystens4^ This would provide useful information in terms of overall effeciency 



of the different system configurations. 



1- 



Vniile all of the factors mentioned should be taken into consideration 

of the ^design aii^. purchase of CBS systems, rapidly increasing technological 

advances require ^hat future developments be anticipated. For example, 

at the^ present time network aystems are more cost effective than stand-alones 

> 

when a large number 0^ terminals is required. However, thig ^d.ll'iiot 

be the case ifi a few years when microprocessors, working together, will give* 

; . • . 

small systems most of the functions of large ones at a fraction of the 

, * - ' ' .* ^ ^ * 

^^st* Thus, the final recommendation for research in the area of CBS is to 

approach CBS training with a futuristic orientlation to ensure maximal 

utilization* of newly emerging " technologies. • 
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